Skip to content

Conversation

@github-actions
Copy link
Contributor

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added the tag: no release notes Changes to exclude from release notes label Dec 22, 2024
@github-actions github-actions bot requested a review from a team as a code owner December 22, 2024 04:18
@github-actions github-actions bot added the tag: dependencies Dependencies related changes label Dec 22, 2024
@github-actions github-actions bot requested review from a team as code owners December 22, 2024 04:18
@github-actions github-actions bot requested review from manuel-alvarez-alvarez, nikita-tkachenko-datadog, shatzi and smola and removed request for a team December 22, 2024 04:18
@pr-commenter
Copy link

pr-commenter bot commented Dec 22, 2024

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1734841817 1734842207
end_time 2024-12-22T04:31:34 2024-12-22T04:38:03
git_branch master ci/update-gradle-dependencies-20241222
git_commit_sha 37acd7b 0f47714
start_time 2024-12-22T04:30:18 2024-12-22T04:36:48
See matching parameters
Baseline Candidate
ci_job_id 747776535 747776535
ci_pipeline_id 51701472 51701472
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1734841056 1734841056

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-18.738µs; +12.019µs] or [-7.032%; +4.511%]
unstable
[-27.142µs; +23.496µs] or [-8.936%; +7.736%]
unstable
[-37.601µs; +34.786µs] or [-11.857%; +10.969%]
unstable
[-126.386µs; +76.829µs] or [-20.856%; +12.678%]
same
scenario:basic same same same unstable
[-35.697µs; +39.981µs] or [-6.495%; +7.275%]
unstable
[-168.668op/s; +168.668op/s] or [-6.747%; +6.747%]
scenario:loop unsure
[+0.346µs; +7.356µs] or [+0.003%; +0.068%]
same same same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (303.737 µs) : 280, 327
.   : milestone, 304,
basic (312.08 µs) : 302, 322
.   : milestone, 312,
loop (11.054 ms) : 11021, 11087
.   : milestone, 11054,
section candidate
noprobe (301.914 µs) : 277, 327
.   : milestone, 302,
basic (312.052 µs) : 302, 322
.   : milestone, 312,
loop (11.058 ms) : 11024, 11092
.   : milestone, 11058,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 303.737 µs [280.241 µs, 327.233 µs]
basic 312.08 µs [302.419 µs, 321.741 µs]
loop 11.054 ms [11.021 ms, 11.087 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 301.914 µs [277.15 µs, 326.678 µs]
basic 312.052 µs [301.884 µs, 322.221 µs]
loop 11.058 ms [11.024 ms, 11.092 ms]

@pr-commenter
Copy link

pr-commenter bot commented Dec 22, 2024

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20241222
git_commit_date 1734727199 1734841078
git_commit_sha 37acd7b 89506c4
release_version 1.45.0-SNAPSHOT~37acd7bbca 1.45.0-SNAPSHOT~89506c4592
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1734843690 1734843690
ci_job_id 747777019 747777019
ci_pipeline_id 51701482 51701482
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 5 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.45.0-SNAPSHOT~89506c4592, baseline=1.45.0-SNAPSHOT~37acd7bbca

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.054 s) : 0, 1053530
Total [baseline] (10.395 s) : 0, 10394639
Agent [candidate] (1.057 s) : 0, 1057284
Total [candidate] (10.534 s) : 0, 10534206
section appsec
Agent [baseline] (1.187 s) : 0, 1187131
Total [baseline] (10.676 s) : 0, 10675505
Agent [candidate] (1.19 s) : 0, 1189864
Total [candidate] (10.714 s) : 0, 10714233
section iast
Agent [baseline] (1.177 s) : 0, 1176685
Total [baseline] (10.935 s) : 0, 10934739
Agent [candidate] (1.184 s) : 0, 1183739
Total [candidate] (10.956 s) : 0, 10955952
section profiling
Agent [baseline] (1.27 s) : 0, 1269906
Total [baseline] (10.755 s) : 0, 10755482
Agent [candidate] (1.285 s) : 0, 1284543
Total [candidate] (10.826 s) : 0, 10825754
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent appsec 1.187 s 133.601 ms (12.7%)
Agent iast 1.177 s 123.154 ms (11.7%)
Agent profiling 1.27 s 216.376 ms (20.5%)
Total tracing 10.395 s -
Total appsec 10.676 s 280.866 ms (2.7%)
Total iast 10.935 s 540.1 ms (5.2%)
Total profiling 10.755 s 360.843 ms (3.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent appsec 1.19 s 132.581 ms (12.5%)
Agent iast 1.184 s 126.455 ms (12.0%)
Agent profiling 1.285 s 227.259 ms (21.5%)
Total tracing 10.534 s -
Total appsec 10.714 s 180.027 ms (1.7%)
Total iast 10.956 s 421.746 ms (4.0%)
Total profiling 10.826 s 291.548 ms (2.8%)
gantt
    title petclinic - break down per module: candidate=1.45.0-SNAPSHOT~89506c4592, baseline=1.45.0-SNAPSHOT~37acd7bbca

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (711.949 ms) : 0, 711949
BytebuddyAgent [candidate] (713.537 ms) : 0, 713537
GlobalTracer [baseline] (255.311 ms) : 0, 255311
GlobalTracer [candidate] (257.472 ms) : 0, 257472
AppSec [baseline] (57.224 ms) : 0, 57224
AppSec [candidate] (60.207 ms) : 0, 60207
Remote Config [baseline] (710.738 µs) : 0, 711
Remote Config [candidate] (687.239 µs) : 0, 687
Telemetry [baseline] (13.325 ms) : 0, 13325
Telemetry [candidate] (10.41 ms) : 0, 10410
section appsec
BytebuddyAgent [baseline] (729.392 ms) : 0, 729392
BytebuddyAgent [candidate] (731.935 ms) : 0, 731935
GlobalTracer [baseline] (252.852 ms) : 0, 252852
GlobalTracer [candidate] (253.459 ms) : 0, 253459
AppSec [baseline] (171.611 ms) : 0, 171611
AppSec [candidate] (171.154 ms) : 0, 171154
Remote Config [baseline] (657.077 µs) : 0, 657
Remote Config [candidate] (659.64 µs) : 0, 660
Telemetry [baseline] (8.007 ms) : 0, 8007
Telemetry [candidate] (7.958 ms) : 0, 7958
IAST [baseline] (19.404 ms) : 0, 19404
IAST [candidate] (19.457 ms) : 0, 19457
section iast
BytebuddyAgent [baseline] (826.883 ms) : 0, 826883
BytebuddyAgent [candidate] (832.711 ms) : 0, 832711
GlobalTracer [baseline] (246.536 ms) : 0, 246536
GlobalTracer [candidate] (247.494 ms) : 0, 247494
AppSec [baseline] (57.733 ms) : 0, 57733
AppSec [candidate] (57.932 ms) : 0, 57932
Remote Config [baseline] (669.535 µs) : 0, 670
Remote Config [candidate] (651.43 µs) : 0, 651
Telemetry [baseline] (8.675 ms) : 0, 8675
Telemetry [candidate] (8.574 ms) : 0, 8574
IAST [baseline] (21.304 ms) : 0, 21304
IAST [candidate] (21.306 ms) : 0, 21306
section profiling
BytebuddyAgent [baseline] (700.311 ms) : 0, 700311
BytebuddyAgent [candidate] (709.943 ms) : 0, 709943
GlobalTracer [baseline] (370.345 ms) : 0, 370345
GlobalTracer [candidate] (373.249 ms) : 0, 373249
AppSec [baseline] (53.887 ms) : 0, 53887
AppSec [candidate] (54.322 ms) : 0, 54322
Remote Config [baseline] (644.699 µs) : 0, 645
Remote Config [candidate] (662.027 µs) : 0, 662
Telemetry [baseline] (7.825 ms) : 0, 7825
Telemetry [candidate] (7.88 ms) : 0, 7880
ProfilingAgent [baseline] (95.447 ms) : 0, 95447
ProfilingAgent [candidate] (96.284 ms) : 0, 96284
Profiling [baseline] (95.47 ms) : 0, 95470
Profiling [candidate] (96.308 ms) : 0, 96308
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.45.0-SNAPSHOT~89506c4592, baseline=1.45.0-SNAPSHOT~37acd7bbca

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1060410
Total [baseline] (8.605 s) : 0, 8604896
Agent [candidate] (1.049 s) : 0, 1049356
Total [candidate] (8.575 s) : 0, 8575127
section iast
Agent [baseline] (1.176 s) : 0, 1176139
Total [baseline] (9.154 s) : 0, 9154272
Agent [candidate] (1.178 s) : 0, 1177951
Total [candidate] (9.203 s) : 0, 9203395
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.173 s) : 0, 1173369
Total [baseline] (9.137 s) : 0, 9136570
Agent [candidate] (1.185 s) : 0, 1185259
Total [candidate] (9.212 s) : 0, 9211814
section iast_TELEMETRY_OFF
Agent [baseline] (1.18 s) : 0, 1180490
Total [baseline] (9.228 s) : 0, 9228301
Agent [candidate] (1.173 s) : 0, 1173194
Total [candidate] (9.178 s) : 0, 9177824
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent iast 1.176 s 115.729 ms (10.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.173 s 112.959 ms (10.7%)
Agent iast_TELEMETRY_OFF 1.18 s 120.08 ms (11.3%)
Total tracing 8.605 s -
Total iast 9.154 s 549.376 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.137 s 531.674 ms (6.2%)
Total iast_TELEMETRY_OFF 9.228 s 623.405 ms (7.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent iast 1.178 s 128.595 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.185 s 135.903 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.173 s 123.838 ms (11.8%)
Total tracing 8.575 s -
Total iast 9.203 s 628.268 ms (7.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.212 s 636.687 ms (7.4%)
Total iast_TELEMETRY_OFF 9.178 s 602.697 ms (7.0%)
gantt
    title insecure-bank - break down per module: candidate=1.45.0-SNAPSHOT~89506c4592, baseline=1.45.0-SNAPSHOT~37acd7bbca

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.516 ms) : 0, 716516
BytebuddyAgent [candidate] (709.874 ms) : 0, 709874
GlobalTracer [baseline] (257.459 ms) : 0, 257459
GlobalTracer [candidate] (255.03 ms) : 0, 255030
AppSec [baseline] (59.516 ms) : 0, 59516
AppSec [candidate] (57.684 ms) : 0, 57684
Remote Config [baseline] (697.059 µs) : 0, 697
Remote Config [candidate] (688.482 µs) : 0, 688
Telemetry [baseline] (11.176 ms) : 0, 11176
Telemetry [candidate] (11.147 ms) : 0, 11147
section iast
BytebuddyAgent [baseline] (827.44 ms) : 0, 827440
BytebuddyAgent [candidate] (828.807 ms) : 0, 828807
GlobalTracer [baseline] (245.894 ms) : 0, 245894
GlobalTracer [candidate] (246.304 ms) : 0, 246304
AppSec [baseline] (57.796 ms) : 0, 57796
AppSec [candidate] (57.913 ms) : 0, 57913
Remote Config [baseline] (655.405 µs) : 0, 655
Remote Config [candidate] (639.957 µs) : 0, 640
Telemetry [baseline] (8.467 ms) : 0, 8467
Telemetry [candidate] (8.426 ms) : 0, 8426
IAST [baseline] (21.04 ms) : 0, 21040
IAST [candidate] (20.917 ms) : 0, 20917
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (825.418 ms) : 0, 825418
BytebuddyAgent [candidate] (833.861 ms) : 0, 833861
GlobalTracer [baseline] (245.168 ms) : 0, 245168
GlobalTracer [candidate] (247.666 ms) : 0, 247666
AppSec [baseline] (57.639 ms) : 0, 57639
AppSec [candidate] (58.036 ms) : 0, 58036
Remote Config [baseline] (654.36 µs) : 0, 654
Remote Config [candidate] (657.561 µs) : 0, 658
Telemetry [baseline] (8.425 ms) : 0, 8425
Telemetry [candidate] (8.532 ms) : 0, 8532
IAST [baseline] (21.203 ms) : 0, 21203
IAST [candidate] (21.505 ms) : 0, 21505
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (830.353 ms) : 0, 830353
BytebuddyAgent [candidate] (824.612 ms) : 0, 824612
GlobalTracer [baseline] (247.375 ms) : 0, 247375
GlobalTracer [candidate] (246.551 ms) : 0, 246551
AppSec [baseline] (57.895 ms) : 0, 57895
AppSec [candidate] (57.559 ms) : 0, 57559
Remote Config [baseline] (642.776 µs) : 0, 643
Remote Config [candidate] (631.206 µs) : 0, 631
Telemetry [baseline] (8.373 ms) : 0, 8373
Telemetry [candidate] (8.258 ms) : 0, 8258
IAST [baseline] (20.873 ms) : 0, 20873
IAST [candidate] (20.653 ms) : 0, 20653
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-12-22T04:31:28 2024-12-22T04:38:23
git_branch master ci/update-gradle-dependencies-20241222
git_commit_date 1734727199 1734841078
git_commit_sha 37acd7b 89506c4
release_version 1.45.0-SNAPSHOT~37acd7bbca 1.45.0-SNAPSHOT~89506c4592
start_time 2024-12-22T04:31:14 2024-12-22T04:38:10
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1734842655 1734842655
ci_job_id 747777020 747777020
ci_pipeline_id 51701482 51701482
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~89506c4592, baseline=1.45.0-SNAPSHOT~37acd7bbca
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.35 ms) : 1330, 1370
.   : milestone, 1350,
appsec (1.741 ms) : 1717, 1765
.   : milestone, 1741,
appsec_no_iast (1.761 ms) : 1736, 1785
.   : milestone, 1761,
iast (1.496 ms) : 1473, 1519
.   : milestone, 1496,
profiling (1.502 ms) : 1478, 1526
.   : milestone, 1502,
tracing (1.473 ms) : 1447, 1498
.   : milestone, 1473,
section candidate
no_agent (1.344 ms) : 1324, 1363
.   : milestone, 1344,
appsec (1.745 ms) : 1721, 1769
.   : milestone, 1745,
appsec_no_iast (1.763 ms) : 1739, 1787
.   : milestone, 1763,
iast (1.481 ms) : 1458, 1504
.   : milestone, 1481,
profiling (1.515 ms) : 1490, 1539
.   : milestone, 1515,
tracing (1.478 ms) : 1453, 1503
.   : milestone, 1478,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.35 ms [1.33 ms, 1.37 ms] -
appsec 1.741 ms [1.717 ms, 1.765 ms] 391.179 µs (29.0%)
appsec_no_iast 1.761 ms [1.736 ms, 1.785 ms] 410.674 µs (30.4%)
iast 1.496 ms [1.473 ms, 1.519 ms] 145.907 µs (10.8%)
profiling 1.502 ms [1.478 ms, 1.526 ms] 152.07 µs (11.3%)
tracing 1.473 ms [1.447 ms, 1.498 ms] 122.649 µs (9.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.344 ms [1.324 ms, 1.363 ms] -
appsec 1.745 ms [1.721 ms, 1.769 ms] 401.192 µs (29.9%)
appsec_no_iast 1.763 ms [1.739 ms, 1.787 ms] 419.556 µs (31.2%)
iast 1.481 ms [1.458 ms, 1.504 ms] 137.195 µs (10.2%)
profiling 1.515 ms [1.49 ms, 1.539 ms] 170.779 µs (12.7%)
tracing 1.478 ms [1.453 ms, 1.503 ms] 134.39 µs (10.0%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.45.0-SNAPSHOT~89506c4592, baseline=1.45.0-SNAPSHOT~37acd7bbca
    dateFormat X
    axisFormat %s
section baseline
no_agent (369.832 µs) : 349, 390
.   : milestone, 370,
iast (495.271 µs) : 474, 517
.   : milestone, 495,
iast_FULL (646.037 µs) : 625, 668
.   : milestone, 646,
iast_GLOBAL (517.725 µs) : 496, 540
.   : milestone, 518,
iast_HARDCODED_SECRET_DISABLED (483.9 µs) : 463, 505
.   : milestone, 484,
iast_INACTIVE (444.629 µs) : 424, 466
.   : milestone, 445,
iast_TELEMETRY_OFF (484.08 µs) : 462, 506
.   : milestone, 484,
tracing (446.096 µs) : 425, 467
.   : milestone, 446,
section candidate
no_agent (371.27 µs) : 351, 391
.   : milestone, 371,
iast (484.779 µs) : 463, 506
.   : milestone, 485,
iast_FULL (649.943 µs) : 628, 672
.   : milestone, 650,
iast_GLOBAL (518.408 µs) : 496, 541
.   : milestone, 518,
iast_HARDCODED_SECRET_DISABLED (489.811 µs) : 468, 511
.   : milestone, 490,
iast_INACTIVE (448.967 µs) : 428, 470
.   : milestone, 449,
iast_TELEMETRY_OFF (476.427 µs) : 454, 499
.   : milestone, 476,
tracing (443.292 µs) : 423, 464
.   : milestone, 443,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 369.832 µs [349.378 µs, 390.287 µs] -
iast 495.271 µs [473.863 µs, 516.678 µs] 125.438 µs (33.9%)
iast_FULL 646.037 µs [624.519 µs, 667.554 µs] 276.204 µs (74.7%)
iast_GLOBAL 517.725 µs [495.775 µs, 539.676 µs] 147.893 µs (40.0%)
iast_HARDCODED_SECRET_DISABLED 483.9 µs [462.839 µs, 504.961 µs] 114.068 µs (30.8%)
iast_INACTIVE 444.629 µs [423.675 µs, 465.583 µs] 74.796 µs (20.2%)
iast_TELEMETRY_OFF 484.08 µs [462.456 µs, 505.704 µs] 114.248 µs (30.9%)
tracing 446.096 µs [425.29 µs, 466.902 µs] 76.264 µs (20.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 371.27 µs [351.183 µs, 391.357 µs] -
iast 484.779 µs [463.372 µs, 506.185 µs] 113.509 µs (30.6%)
iast_FULL 649.943 µs [627.807 µs, 672.079 µs] 278.673 µs (75.1%)
iast_GLOBAL 518.408 µs [495.881 µs, 540.934 µs] 147.138 µs (39.6%)
iast_HARDCODED_SECRET_DISABLED 489.811 µs [468.435 µs, 511.186 µs] 118.541 µs (31.9%)
iast_INACTIVE 448.967 µs [428.107 µs, 469.828 µs] 77.697 µs (20.9%)
iast_TELEMETRY_OFF 476.427 µs [454.245 µs, 498.609 µs] 105.157 µs (28.3%)
tracing 443.292 µs [422.513 µs, 464.071 µs] 72.022 µs (19.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20241222
git_commit_date 1734727199 1734841078
git_commit_sha 37acd7b 89506c4
release_version 1.45.0-SNAPSHOT~37acd7bbca 1.45.0-SNAPSHOT~89506c4592
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1734843310 1734843310
ci_job_id 747777021 747777021
ci_pipeline_id 51701482 51701482
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~89506c4592, baseline=1.45.0-SNAPSHOT~37acd7bbca
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.604 s) : 15604000, 15604000
.   : milestone, 15604000,
appsec (14.853 s) : 14853000, 14853000
.   : milestone, 14853000,
iast (18.689 s) : 18689000, 18689000
.   : milestone, 18689000,
iast_GLOBAL (17.84 s) : 17840000, 17840000
.   : milestone, 17840000,
profiling (15.622 s) : 15622000, 15622000
.   : milestone, 15622000,
tracing (15.117 s) : 15117000, 15117000
.   : milestone, 15117000,
section candidate
no_agent (14.779 s) : 14779000, 14779000
.   : milestone, 14779000,
appsec (15.084 s) : 15084000, 15084000
.   : milestone, 15084000,
iast (19.014 s) : 19014000, 19014000
.   : milestone, 19014000,
iast_GLOBAL (18.052 s) : 18052000, 18052000
.   : milestone, 18052000,
profiling (14.849 s) : 14849000, 14849000
.   : milestone, 14849000,
tracing (14.813 s) : 14813000, 14813000
.   : milestone, 14813000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.604 s [15.604 s, 15.604 s] -
appsec 14.853 s [14.853 s, 14.853 s] -751.0 ms (-4.8%)
iast 18.689 s [18.689 s, 18.689 s] 3.085 s (19.8%)
iast_GLOBAL 17.84 s [17.84 s, 17.84 s] 2.236 s (14.3%)
profiling 15.622 s [15.622 s, 15.622 s] 18.0 ms (0.1%)
tracing 15.117 s [15.117 s, 15.117 s] -487.0 ms (-3.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.779 s [14.779 s, 14.779 s] -
appsec 15.084 s [15.084 s, 15.084 s] 305.0 ms (2.1%)
iast 19.014 s [19.014 s, 19.014 s] 4.235 s (28.7%)
iast_GLOBAL 18.052 s [18.052 s, 18.052 s] 3.273 s (22.1%)
profiling 14.849 s [14.849 s, 14.849 s] 70.0 ms (0.5%)
tracing 14.813 s [14.813 s, 14.813 s] 34.0 ms (0.2%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.45.0-SNAPSHOT~89506c4592, baseline=1.45.0-SNAPSHOT~37acd7bbca
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (2.351 ms) : 2310, 2393
.   : milestone, 2351,
iast (2.09 ms) : 2037, 2143
.   : milestone, 2090,
iast_GLOBAL (2.147 ms) : 2094, 2200
.   : milestone, 2147,
profiling (1.956 ms) : 1914, 1998
.   : milestone, 1956,
tracing (1.937 ms) : 1897, 1978
.   : milestone, 1937,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.352 ms) : 2310, 2394
.   : milestone, 2352,
iast (2.098 ms) : 2045, 2151
.   : milestone, 2098,
iast_GLOBAL (2.148 ms) : 2095, 2202
.   : milestone, 2148,
profiling (1.981 ms) : 1937, 2024
.   : milestone, 1981,
tracing (1.945 ms) : 1904, 1986
.   : milestone, 1945,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 2.351 ms [2.31 ms, 2.393 ms] 877.614 µs (59.6%)
iast 2.09 ms [2.037 ms, 2.143 ms] 616.603 µs (41.8%)
iast_GLOBAL 2.147 ms [2.094 ms, 2.2 ms] 673.087 µs (45.7%)
profiling 1.956 ms [1.914 ms, 1.998 ms] 482.548 µs (32.7%)
tracing 1.937 ms [1.897 ms, 1.978 ms] 463.743 µs (31.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.352 ms [2.31 ms, 2.394 ms] 881.291 µs (59.9%)
iast 2.098 ms [2.045 ms, 2.151 ms] 626.882 µs (42.6%)
iast_GLOBAL 2.148 ms [2.095 ms, 2.202 ms] 677.581 µs (46.1%)
profiling 1.981 ms [1.937 ms, 2.024 ms] 510.017 µs (34.7%)
tracing 1.945 ms [1.904 ms, 1.986 ms] 474.261 µs (32.2%)

@pr-commenter
Copy link

pr-commenter bot commented Dec 22, 2024

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20241222
git_commit_date 1734727199 1734841064
git_commit_sha 37acd7b 69419d0
See matching parameters
Baseline Candidate
ci_job_date 1734842362 1734842362
ci_job_id 747776729 747776729
ci_pipeline_id 51701476 51701476
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Dec 22, 2024

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20241222
git_commit_date 1734727199 1734841077
git_commit_sha 37acd7b 0e22c83
See matching parameters
Baseline Candidate
ci_job_date 1734842365 1734842365
ci_job_id 747776975 747776975
ci_pipeline_id 51701481 51701481
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@amarziali amarziali merged commit 5b1d1e4 into master Dec 30, 2024
147 checks passed
@amarziali amarziali deleted the ci/update-gradle-dependencies-20241222 branch December 30, 2024 09:28
@github-actions github-actions bot added this to the 1.45.0 milestone Dec 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants